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1 What Is a Computation? 


There are many ways to define what is meant by the term “computation”, but most 
people would agree that a computation should satisfy the following characteristics: 


1. A computation should be mechanical in the sense that there is a unique way to 
proceed at any point. (Or, at least if there is not a unique approach, then all 
approaches should lead to the same result. For example, to calculate the sum 
x+y-+ zit doesn’t matter whether x + y is calculated first, or y + z. The best 
situation, of course, is if there is no ambiguity whatsoever.) 


2. It must be possible to state the rules for a computation in a finite manner. We 
should not be able to list an infinte number of possible options. 


3. Similarly, the size of the input and size of the output must be finite. 


4. It should be clear when the process has terminated. (It may be that some com- 
putations never terminate, but those are usually not particularly useful, except, 
possibly, in a theoretical sense.)! 


There are a number of different very precisely-defined mathematical schemes that sat- 
isfy the rules above. We can define a Turing machine that is a sort of mathematical 
model of a computer and see what it can compute. We can define a set of primitve 
functions that are obviously computable and some rules for combining the functions 
that can obviously be performed to produce new functions and then examine what sorts 
of functions can be generated. We can define a formal language with syntax and gram- 
mar and add rules for manipulation of sentences in the language and look to see what 
sorts of sentences can be “proved” from a set of sentences that are “obviously” true. 
Or even more simply, we can examine the sets of sentences that can be generated from 


'This brings up the following consideration: suppose there is a computational method that satisfies all of 
the conditions above, but may not terminate in all cases. In other words, when you begin the computation, 
you know that if it terminates, it will terminate with the correct answer, but you do not know whether it 
will terminate, or have any upper bound on the amount of time it may take to complete the calculation. Just 
because you have been calculating for a million years does not mean that the computation will not terminate; 
it may terminate on the next step. A surprising number of very useful calculations that are performed all the 
time have this form. 


various mathematically-defined grammars that generate valid sentences from a primi- 
tive starting point. There are other methods to approach the idea of what is meant by a 
computation as well. 


What is incredible is that all the methods above result in exactly the same set of com- 
putations, if you interpret the results of each as encodings of the others. Although at 
first glance, these computational schemes may seem wildly different, each results in 
exactly the same set of answers, indicating that there is something incredibly special 
about the resultant set of computations. 


There is no space in this article to examine all the ideas and approaches mentioned in 
the paragraphs above, but we will be able to take a look at one sort of computation; 
namely, computaions that can be performed by the so-called recursive functions. 


The first restriction we will make is that we will consider only mathematical functions 
that take natural numbers (one or more) as inputs and yield a natural number as the 
output. In what follows, we will define the set of natural numbers? as follows: 


N = {0,1,2,3,...}. 


We want the term “computation” to include all of the obvious standard calculations: 
addition, subtraction, multiplication, division, factorization, integer powers, et cetera, 
as well as combinations of those. You may never have thought about operations like 
addition and multiplication as functions in the same way as you did f(x) in your alge- 
bra class, but they are. As an example, let us show how one might indicate arithmetic 
operations like z- y+ z-(x+w). 


One way is to replace the infix operators “+” amd “-” by functions of two variables: 
A(x, y) represents x + y and M(x, y) represents x - y. Then the expression x - y + 
z-+(x + w) in the previous paragraph can be represented with the following functional 
notation: 


A(M (a2, y),M(z, A(z, w))). 


We are of course interested in more complex operations as well. For example, suppose 
the function f(n) is defined to be 0 if m < 2 and the largest prime factor of n otherwise. 
Thus f(0) = f(1) = 0, f(2) = 2, f(3) = 3, F(4) = 2, f(5) = 5, f(6) = 3, and 
so on. In normal circumstances, the definition above is sufficient, but here we are also 
interested in how f(n) might be computed, given n. The expression “largest prime 
factor of n” really doesn’t tell us a mechanical way to calculate that number. 


The fact that we restrict ourselves to the consideration of only functions of the natural 
numbers is hardly a restriction at all. For example, every computer program falls into 
this category, since all the inputs are basically converted to binary (strings of zeros and 
ones) before the program operates on them, and the outputs are binary strings before 
the final conversion to characters or colors on the screen or whatever else is produced. 
We can just consider these binary input and output strings to be natural numbers so the 
computer program is just a function mapping natural numbers to natural numbers. 


2Some people do not include zero as a natural number, but we will do so here. 


Similarly, the floating-point numbers used in computer computation are only finite 
approximations of the “real” real numbers. They are saved as 32, 64, or occasionally 
128 bit patterns, but these could equally well be considered to be 32, 64, or 128 bit 
natural numbers. To be sure, the calculation of 2.71828 + 3.14159, interpreted as a 
purely integer operation is a very strange one, but it can be considered to be one. 


2 Some Concrete Examples 


Here are some examples that will be recursive functions, although to show them to be 
so will require some work. 
2.1 The standard arithmetic functions 


e The successor function: S(x) = « + 1. 


e The constant functions: (0, 1, 2, 3,...). 


Addition and multiplication: A(z, y) =a+yand M(z,y) =a- y. 


e Decrement, Subtraction, Division and Remainder: x—1, —y, x/y and x mod y. 
Obviously subtraction cannot go negative, so x — y is defined to be zero if y > x. 
Similarly, division yields the whole-number divisor and the modulus function 
yields the remainder, so y - (x/y) + a mod y = «. 


Integer power: x”. 


Obviously we want to be able to define combinations of the functions above so that we 
can perform calculations like (2 + y)@*—”) — y. 


2.2 Recursive Functions 


Recursion: If you know what recursion is, just remember the answer. 
Otherwise, locate someone who is standing closer to Douglas Hofstadter 
than you are, and ask him/her what recursion is. 

Andrew Plotkin 


The quotation above provides a surprisingly nice image of how recursion works: A 
recursive calculation is one that can be done for the smallest natural number, zero, and 
the calculation for larger numbers always depends on calculations for smaller ones. 


2.2.1 The Factorial Function 


Probably the first recursive defintion that most people see is for the factorial function: 
f(n) =nl=n-(n-1)-(n—2)---3-2-1: 


1: ifn=0, 
f(r) = { n-f(n—1) : otherwise. 


The recursive definition above tells us that f(0) = 1, and that to compute the value of 
f(n) if n > 0 all you need to do is look up f(n — 1) and multiply that by n. 


So to calculate 3! we see that the result is 3 multiplied by 2!, but then to get 2! you need 
to multiply 2 by 1!, and so on. The net result is 3- 2-1-1 = 6. More formally: 
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2.2.2 The Fibonacci Sequence 


An interesting function generates the Fibonacci sequence, 1,1,2,3,5,8,18,21,..., 
where the first two entries are 1 and after that, each is obtained by adding the previous 


two: 
1 : ifn=O0orn=1, 


AMS { f(n-—1)+ f(n—2) : otherwise. 
Here is the calculation for f(5): 


f(5) = f(4) + f(3) 


The example above deserves a couple of comments. First, the calculation as presented 
is very inefficient: the values of f(n) for the small values of n are calculated over 
and over again. Second, in the calculation above a number of substitutions of f(n) by 
f(n — 1) + f(m — 2) were made in each line. One of the ways we characterized a 
computation in the first section of this article was as a sequence of operations where 
there was no question about which one was to be done first. In this case, it makes no 
difference, and in addition, it would be easy to specify exactly the order in which the 
substitutions should be made. For example, we could just say that at any stage of the 
calculation, the leftmost possible expansion/substitution would be done. 


2.2.3. The Greatest Common Divisor 


An extremely important function yields the greatest common divisor of two numbers. 
For example, gcd(12, 18) = 6, since 6 is the largest number that divides both 12 and 
18 evenly. There is a very nice recursive definition for the gcd function: 


d( = n : ifm=0, 
Seng gcd(n mod m,m) : otherwise. 


For example, to calculate gcd(29680, 17360), we proceed as follows: 


= gcd(5040 mod 2240, 2240) = ged(560, 2240) 
= gcd(2240 mod 560, 560) = gcd(0, 560) 
= 560. 


gcd(29680, 17360) = gcd(17360 mod 29680, 29680) = gcd(17360, 29680) 
=  gcd(29680 mod 17360, 17360) = gcd(12320, 17360) 
= gcd(17360 mod 12320, 12320) = ged(5040, 12320) 
=  gcd(12320 mod 5040, 5040) = ged(2240, 5040) 
( 
( 


The result, 560 is correct, since 29680 = 53 - 560 and 17360 = 31 - 560, and 53 and 
31 are obviously relatively prime. Notice that the first application of recursion simply 
reverses the inputs which guarantees that afterwards the first parameter will be smaller 
than the second. After that, the recursion guarantees that each successive application 
has smaller values for the first parameter, and so it will eventually get to zero. Finally, 
it is not hard to show that at every stage of the calculation, the remaining numbers have 
the same greatest common divisor as the previous pair of numbers. 


2.2.4 Some Simple Recursive Functions 


The examples above are all fairly famous; let us now consider some very simple recur- 
sive functions. These examples show that even the arithmetic operations like addition 
and multiplication that we consider to be “primitive” can in fact be defined in terms of 
the even more primitive operation, successor. 


The successor function: S(n) = n+ 1 yields the next larger number above n. With 
the successor function defined, we can define the addition function A(m,n) = m+n 
recursively as follows: 


n : ifm=O0O, 


Amn) = A(k,S(n)) : ifm =S(k). 


The definition above basically amounts to saying that if you add zero to a number, it 
remains the same, and if you add m and n, that’s the same as adding m — 1 andn + 1. 
Eventually the repeated subtractions of 1 from m will get it down to zero, and we know 
how to add zero to any number. 


A slightly different method can be used to define multiplication: M(m,n) = m-n, in 
terms of addition: It’s easy to multiply by zero, and to multiply m by n amounts to the 
same thing as multiplying m — 1 by n and adding n: 


0 : ifm=0, 
M(mn.n) = { A(n,M(k,n)) + ifm = S(k). 


Exponentiation follows the same pattern as multiplication. 


These examples show that we really need nothing more than the successor function 
to define the rest of the standard arithmetic functions. We will now go back to the 
beginning, and give a very formal defintion of what is meant by a recursive function. 


3 Recursive Functions: Informal and Formal Defini- 
tions 


One way to build up a class of functions is to begin with a tiny set of relatively simple 
functions and to build additional functions based on combinations of the simpler ones. 
Then more functions are built upon those and so on. As a simple, concrete example, 
let’s consider the primitive recursive functions. 


The general strategy will be this: we will define the set by giving a set of functions that 
belong to it, and then we will give two rules that will allow us to build more functions 
from functions that are already in the set. Of course once you add those functions to 
the set, it may be possible to apply the rules for building more functions to those and 
thereby obtain even more functions, and so on. If this process: beginning with a few 
functions and then applying the function-building rules to all of them and adding the 
newly-constructed functions to the set, is repeated forever, the resulting set will contain 
all the primitive recursive functions. 


We will choose the initial functions to be functions that are “obviously” easy to com- 
pute: it should be obvious that any human or computer should be able to make those 
computations. The rules for building functions should also produce functions that are 
obviously computable. In other words, they should have the form so that if you are 
convinced that the component functions are computable, it should be obvious to you 
that the resulting functions will also be. 


Later, when we build the set of so-called “general recursive functions”, we will use 
exactly the same strategy. The only difference will be that in addition to the initial 
functions and the rules for primitive recursion, we will add a single additional function- 
building rule. 


3.1. An Informal Description 


In the following section (3.2) we will give a totally formal description of the primitive 
recursive functions, but it’s easy to get lost in the forest of subscripts. In this section, 


we'll give an intuitive description of what we’re trying to do, and then when you read 
the formal definitions in the next section, it should be easy to understand them, based 
on the simpler examples we present here. 


Every function will take some number of natural numbers as inputs and will return a 
natural number as an output. 


3.1.1 The Initial Functions 


There will be three types of functions that we’ll initally add to the set, before we try 
to make more functions from our function-generating rules. The first type consists of 
only a single function, the successor function: S(n) = n + 1. It takes a single natural 
number as an input, adds 1 to it, and returns the result. Hopefully, most people will 
agree that the successor function is computable for any natural number input. 


The other two types consist of an infinite number of functions, but again, hopefully 
most people would agree that all of them are computable. The first type consists of 
all the functions that return zero, no matter what the inputs are. This is an infinite set 
of functions, since we would like to include functions of 1, 2, 3, ... variables. Now in 
practical use, it’s hard to imagine a function that takes a billion (or a google) of natural 
numbers as inputs, but just to be on the safe side, we’ll include all of them. But the 
computation is quite simple: ignore all the inputs and return zero! Here’s what the list 
would look like: 


The second type is essentially a doubly-infinite list of functions, but again, they are all 
quite simple. Each one returns a particular input with no computation done on it. So 
what we add is a series of functions like this: 


pul«) = 2 

Pi(z,y) = 2 p22(@,y) =Y 

pis(@,y,z) =x pos(a,y,2)=Yy — psa(a, y, 2) = 2 

pia(@,Y,2,W) =X poa(t,y,2,w) =y psa(2,y,2,w) =z paa(z,y,z,w) = w 


The idea is simple: we need a set of functions for every possible number of inputs 
that simply return each of the possible inputs. Thus we will need a million different 
functions that take one million inputs: one that returns the first, one that returns the 
second, and so on. Again, most people would agree that, in principle, all of these 
functions are computable. Note that we only talk about functions with a finite number 
of inputs, but of every finite size. The second subscript that is part of the function 
names indicates how many parameters it takes, and the first one tells which of those 
parameters will be returned. 


These are called the “projection functions”. 


What is truly amazing, is that the three function types above: the successor function, 
the functions that return zero, no matter what, and the functions that simply return 
one of their inputs, is all that we need to construct almost any function taking natural 
numbers as input and returning a natural number that you can imagine. 


3.1.2 Composition: The First Construction Method 


The idea is simple: if you know how to compute some functions, you should be able to 
use the outputs of those functions as inputs to other functions. In real analysis, you’ve 
seen expressions like sin(x*) which essentially takes the value x and feeds it to the 
squaring function to obtain x”. Then that value is provided as input to the sin function 
which returns its value. 


The formal definition in section 3.2 may seem like an overly-complicated way to ex- 
press the idea of composition, but it results from the fact that we need to be able to do 
this sort of composition of functions with different numbers of inputs. In other words, 
if f(x,y), g(x,y) and h(x, y) are three functions that we know how to compute, and 
F(a, y, z) is another, then we should be able to compute a new function G(x, y) de- 
fined as follows: 


G(z,y) = F(f(2,y), g(x, y), h(a, y))- 


In other words, G takes two input values and inserts those two into f, g and h, which 
yields three output values. These are then used as the three inputs that F’ requires. 


In the definitons, we will require that each of the functions like f, g and h have the 
same number of parameters. This might appear to be a problem, since you can certainly 
imagine wanting to do something like this: f(x,y) is a function with two inputs, but 
g(x) and h(a) only take a single parameter, but we’d like to define G as follows: 


G(x, y) = F(f(x,y), g(x), h(y)). 


This is not really a problem, since if we need to do something like this, we can define 
new functions g/(x, y) = g(a) and h’(x, y) = h(y). This kind of definiton can easily 
be made with the projection functions illustrated in section 3.1.1. In fact, using the 
notation in that section, we can define: 


h'(x,y) = h(p22(x,y)), 


where the projection function p22 snags the second parameter of a two-parameter func- 
tion and returns it. Note that the expression above has the correct form for function 
composition that we’ve allowed. 


Note that the projection functions will allow us to do things like permute or collapse 
the order of parameters. For example, suppose that we’ve got an interesting function 
already defined: f(x, y, z) and we would like to define a new function g as follows: 


g(x,y) = Fy, 2,2). 


With the projection functions, it is easy: 


g(x,y) _ f(p22(z, y), pi2(x, y), pi2(z, y))- 


3.1.3 Recursion: The Second Construction Method 


The examples of recursion we’ve seen in earlier sections essentially tell how a function 
behaves for the smallest input value (zero) and if the input is not zero, it tells how to 
obtain the result based on the value of the function with a smaller input. This process 
is guaranteed to terminate, since the input value cannot be smaller than zero, and when 
it hits zero, we’ve given an effective way to complete the computation. 


The examples are almost all simple in that they take only a single parameter, and surely 
we'd like to allow for multiple parameters. To keep things simple, though, we’ll only 
allow recursion on one parameter, and this is not a real restriction. Thus we’d like our 
definition to be something like this: 


If n = 0, then f(n,z,y,...,2) can be computed as the value of some function 
g(x,y,..-, 2), where g is some function that we know we can compute. But if n > 0, 
we want to have a function h that may depend not only on the values x, y,..., z, but 


also possibly on n and on f(n — 1,z,y,..., 2. Thus the definition of f will depend 
on two functions: one, g, that uses one fewer parameter than f, and tells what to do if 
nm = 0, and on another function / that has one more parameter than f and tells how to 
do the computation based on the values that f provided, but also the value of f when 
called with n — 1 as its first parameter. 


Note that there’s no penalty for requiring that h have all these parameters: it can ignore 
as many as it wants. 


With all of the above in mind, take a look again at section 2.2.4, and see how the 
definitions of the initial functions and constrution methods could be applied to obtain 
functions like the addition and multiplication of natural numbers beginning only with 
the successor function. 


Now we’ll do essentially the same thing we did over again, but in a totally formal way. 


3.2 Primitive Recursive Functions 


The set of primitive recursive functions is the smallest set of functions that map the 
natural numbers into the natural numbers and include the following functions. The 
first three entries below name specific functions that must be included; the last two are 
basically “recipes” for creating new primitve recursive functions from those that have 
already been shown to be primitive recursive. 


1. The successor function. S(n) = n+ 1. 


2. The constant zero functions. Z;,(n1,72,...,n~) = 0. 


3. The projection functions. pi) (n1,N2,..-,N~) = ni, for every k >i > 0. 


4. Composition of functions. If f(n1,...,7,) is in the set and if g;(m1,..., 72) 
are in the set for 1 < i < k, then 


h(ni,.--,m) = f(gi(m,.--,m1),---,ge(m1,---,1)) 
is in the set. 


5. Primitive recursion. If f(n1,...,,) and g(n1,..., x42) are in the set, then 
the function fh defined as follows is in the set: 


h(O,1,.-.,2~%) = f(mi,...,nk) 
hA(S(n),n1,..., Nk) = GAG iy -s a HE) Ms oN) 


The final recursion condition is very safe in the sense that it will always be possible 
to evaluate functions so defined. The value is defined at zero, and based on that, the 
values at 1,2,3,..., are also defined, each depending upon the result of a calculation 
with a smaller input. 


All the so-called primitive recursive functions are thus defined for all possible input 
values. Such functions are called “total functions”. 


3.3. Examples of Primitive Recursive Functions 


The vast majority of commonly-used arithmetic functions are primitive recursive. In 
this section we’ll build up a few of them. In a sense, it is easier to work with recursive 
functions in this way than with Turing machines, since once we have constructed a 
recursive function and studied its properties, we can just use it as it stands in the def- 
inition of a more complex recursive function. Embedding working Turing machines 
inside other ones requires, at the least, a little more bookkeeping. 


We will list a number of examples below, all in the same format. First, we’ll describe 
exactly the function to be implemented. Next, we will show the formal derivation 
using either the functions listed above or functions that we have derived in previous 
sections. Finally, if warranted, we will include some discussion of the method. Since 
the definitions tend to build one on the other, in this section we have been careful to 
give each function a unique name that may be used in a later definition.>. 


3.3.1 The constant functions 


For any integers m and k, the function C CO) ny, ...,2%) = mis primitive recursive. 


3 Although the defintions that follow may seem fairly trivial, it is a little bit tricky to get them exactly 
right. They may, in fact, not be exactly right in this text. The author was a bit paranoid about getting them 
right, so after he wrote the first draft of this article, he wrote a computer simulator for his definitions of 
primitive recursive functions. Every one of the original definitions had at least a minor error, and some had 
major errors! 
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CO(ns,...,m~) = Zpe(mi,...,ne) 

CY(n,....n~) = S(CO (n1,...,nk)) 
CP (ny,...,mx) = S(CL(n1,...,ne)) 
CP (n,...,n~) = S(C(n1,...,ne)) 


In other words, the successor of the functions that generate the constant output zero is 
the one that has constant output 0, and so on. 


3.3.2 Addition of two natural numbers 


The function A(m, n) = m + nis primitive recursive. 


Ai(ni,n2,n3) = S(PL(n1,n2,n3)) 
A(0,n1) P|) (n1) 
A(S(n),n1) = Ar(A(n, 711), 7,71) 


Addition is based on the idea that if you add zero to something, the result is the some- 
thing. To add n + 1 to something, you can just add 1 to what you get when you add n 
to that same something. 


To define the addition function in a completely rigorous way, we need first to define the 
“helper” function A; as above. This is because in the formal definition of recursion, 
when we define a function with k parameters, we need a k + 1 parameter function to 
provide the recursive part of the definition. 


This example is quite simple: if the first parameter is zero, simply return the second 
parameter. If the first parameter is the successor of n, work out the sum with n as the 
first parameter and then pass that sum, n, and the second parameter to the recursion- 
defining function. In this case, the recursion-defining function has no use for its second 


and third parameters; it simply selects its first parameter (using Pp?) and returns the 
successor of that. 


Because the form of definition of primitve recursive functions is so rigid, we will often 
need to use the trick above of defining one or more helper functions. 


3.3.3 Doubling a natural number 


The function f(a) = 2z is primitive recursive. 
f(m) = ACPI? (1), Pp? (ma) 


11 


Obviously, since we have defined addition in the previous section, multiplying by 2 
is equivalent to adding a number to itself. The only thing that is slighty tricky in the 
defintion above is that to exactly satisfy the form for the substitution construction, we 
must pass functions of the parameter n rather that the parameter itself. This is trivial 


to do: po) is basically the identity function. 


3.3.4 Multiplication of two natural numbers 


The function M(x, y) = x - y is primitive recursive. 


M1(n1, 2,3) = A(P®) (ny, 2,3), P (m1, n2, 3) 
M(0, 71) = Z1(n1) 
M(S(n), 1) = Mi(M(n, 71), 7, 21) 
Multiplication is defined recursively in terms of addition in much the same way that 
addition is defined recursively in terms of the successor function. Multiplication by 
zero yields zero, and to multiply by n + 1, you simply multiply by n and then add an- 
other copy. The structure of the helper function is similar to what we used for addition. 


Exponentiation, which we’ll do next, seems almost identical, but we’ll add one small 
trick. 


3.3.5 Exponentiation of natural numbers 


The function €(x, y) = x”, where 0° is defined to be 1 is primitive recursive. 


M(P\ (ni, na, ns), PS? (ni, n2,n3)) 
Cy (m1) 
= &(Ei(n,n1),n,n1) 
(2) (2) 
E1(Py"(m1, N2), Py’ (m1, n2)) 


a) (n1, 2, N3 
Ex(0, Ny 
E\(S(n), m1 


E(ni, n2 


) 
) 
) 
) 


Primitive recursion is defined for all inputs, so we cannot simply make the expression 
0° be “undefined”. Here, we’ve arbitrarily defined it to the 1. The construction the the 
function € is very similar to multiplication except that an exponent of 0 yields 1. The 
small trick here is that the function €(x, y) = y”, not x¥. To obtain x” we need to 
swap the parameters, and that’s what is done in the final line of the definition. 


3.3.6 Decrement a natural number 
The function A(z) = max(0, x — 1) is primitive recursive. (We use the Greek letter 


delta (A) since we’re reserving the symbol D to stand for subtraction. Think of it as 
standing for “difference”’.) 
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Ax(0, 1) => Z1(n1) 
PH(Ay(n, n1),n, 1) 
A(m) = Ax(P{ (1), Py? (m)) 


is 
R 
= 
s 
T 


Here we would like to define the decrement function directly as a recursive function, 
but it only has one parameter, and every function defined using recursion according to 
our scheme must have at least two. We get around the problem by defining a helper 
function that has an unused parameter, and then we define decrement by plugging a 
“garbage” value into that second slot. 


3.3.7 Subtraction of natural numbers 


The function D(z, y) = max(0, x — y) is primitive recursive. 


AP?) (n1, n2, n3)) 


Do(n1,N2,n3) = 
_ (1) 
= Py (n1) 


) 
D1(0, 71) 

Di(S(n),m1) = Do2(Di(n,n1),n,n1) 
D(m,n2) = Di(P§(2)(ni,n2), Py” (ni, n2)) 


The idea here is that if y is zero, then x — y is x. Otherwise, subtract y — 1 from x — 1. 
It’s a little tricker that it seems, and to make it work nicely, it’s easier to reverse the 
parameters. 


3.3.8 Maximum of two natural numbers 


The function max(z, y) is primitive recursive. 


Hi (0,1, 2) = Pe) 
Hi(S(n),n1,n2) = PSY (Ai(n, m1, n2),n,m1,n2) 
Hi (D(n1, no), Pn, n2)) 


max(n1, 2) 


The max function works by subtracting the second parameter from the first, where 
the subtraction is the usual version restricted to natural numbers. If the result is zero, 
then the second element is larger (or the same size). To perform the “if” statement in 
the previous sentence, we need a helper function that we’ve called H1(n, 1, 2) that 
basically looks at n, to see if it is zero. If n1 = 0, it returns n2; otherwise, n1. 
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3.3.9 Parity of a natural number 


The parity function II(a) = x mod 2 is primitive recursive. 


a(0, 71,2) 
a(S(n),n1,n2) 
II, (0,71) 

Th (S(n),m1 
II(n) 


= C5) (m,n) 

= Z,(a(n,n1,N2),n,n1,N2) 
= 2Z1(n) 

= a(I(n,n1),n,71) 

= Ih(Py"(n),P)”) 


A couple of helper functions make this work. The helper function a returns 1 if the 
first input is zero and zero otherwise. The helper function IT, (n, 1) returns zero for 
an = 0, and a of itself applied to n — 1 otherwise. It is a helper function since it is 
recursive and hence requires at least two parameters. The final definiton of the parity 
function II simply invents a garbage second parameter for II;. 


3.3.10 Sum of values of a primitive recursive function 


If f(n) is a primitive recursive function, then so is the following function: 


oi(n 


o2(n1,n2,n 3, *)(n1,n2,ns)) 


o4(0, Ny => Z1(n1) 


o4(S(n), m1 


) 
) 
03(m1,N2,n3) = A(P (ni, n2, n3), 02(n11, n2,N3)) 
) 
) 
of(n) 


There is nothing particularly tricky going on above—just a lot of technical problems 
with numbers of parameters. 


Notice that with a couple of trivial changes we can also show that finite products of the 
same form of primitive recursive functions are primitive recursive: 
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3.4 Characteristic Functions (or Predicates) 


If S CN, then the characteristic function of S, indicated by yg(n), is defined to be 1 if 
n € SandOifn ¢S. 


A characteristic function can also be thought of as a predicate (a special function that 
returns either “true” or “‘false’”’) that takes inputs from the natural numbers. The usual 
convention is the 1 corresponds to “true” and 0 to “false”. In this way you can imagine 
a function like prime(a) (or x > 7) that returns 1 (true) if and only if x is prime (or 
x > 77). 


We will be interested, of course, in which characteristic functions (or predicates) are 
primitive recursive (and later, general recursive) functions. 


If characteristic functions are interpreted as predicates, then we can also investigate 
logical combinations of those functions. In this way we will be able to build predicates 
like prime(x) A (a > 7). (The A symbol signifies a logical “and” operation. In what 
follows, V will indicate logical “or” and — will indicate logical “not’.) 


It turns out that if two predicates p and q are primitive recursive (recursive) then the 
predicates p A q, p V q and —p will also be primitive recursive (recursive). This is easy 
to see, since if p is a predicate, then 1 — p corresponds to ~p. Similarly, if p and q 
are predicates, then pq (the product of p and q) corresponds to p A q. From these two 
facts and from De Morgan’s law: p V g = 7((—p) A (7@)) we can infer that p V q is 
also primitive recursive. (All the other common logical operations like implication, 
exclusive-or, nand, nor, et cetera, can be similarly constructed from / and —). 


(Notice that if we consider the functions to be characteristic functions of subsets of N 
instead of predicates, then the constructions above yield new characteristic functions 
corresponding the set operations: union (U <> V), intersection (1 < A), set comple- 
ment (’ <> —), et cetera.) 


In this section we will show how to define a few interesting primtive recursive predi- 
cates. The definitons below will not be so formal as they were in the previous section. 
Hopefully the examples there indicate how one might go about constructing the abso- 
lutely formal definitions. In every case, this formalization can be accomplished. 


3.4.1 True and False are primitive recursive 


True(x) = CY) (2) 
False(z) = 2Z,(x) 
3.4.2 Finite sets 
We will show that the characteristic function of any finite set is primtive recursive. 


This will be done by induction. The characteristic function of the empty set ¢ is: 
x4(x) = Z1(x). We will be done if we can show that if every characteristic function 
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of a set of n — 1 elements is primitive recursive then so is the characteristic function of 
any set with n elements. 


We will begin by showing that the characteristic function of any singleton set is primi- 
tive recursive. Here is the definition of y 49} (7): 


f0,m) = cf 
f(S(n), 1) = 23(f(n,n1),n, 71) 
xgoy(n) = f (PL? (n), PL? (n)) 


Next, suppose that we have defined x ¢o}(7), x41} (™), X{2}(™), ++, X¢n}(™) and we 
wish to define x ¢,41}(n). Here is how to proceed: 


x(n) = x¢43(S(n)) 
XY (ny,n2,n3) = xiet? (PS? (m1, n2,n3)) 


f(S(m),m 


) 
) 
f(0,n1) = 2Z,(n1) 
) 
X{k-+1} (7) 


= f(PP(n),PL?(m)) 


Now we have defined (by induction) the characteristic function of every singleton set. 
But we know from our previous discussion that if f and g are two predicates that are 
primitive recursive, then f V g is also primitive recursive. But f V g corresponds to the 
predicate of the union of the values for which both f and g are true, so we can build up 
a characteristic function for any finite collection of natural numbers. 


3.4.3 Bounded Quantification 


If P(n,n1,...,) is a primitive recursive predicate, then so is: 


EB(y,m,..-Me) = Sa ((a < y) A P(2,m1,---nx))- 
In English, this new predicate EF (y,1,.-., x) is true if there exists some value of 


x < ysuch that P(x,n1,...,n,) is true. The “F”’ superscript indicates a finite search. 
Notice that this is just a finite product: 


EB(y,m1,---,7) = LPG: 


We can similarly test to see if a predicate is true for all input values less than some 
fixed number since: 


Va ((x < y) A P(a,ni1,-...,ne)) = 7a ((x@ < y) AaP(a,71,...,MK))- 


Based on this sort of operator, we can construct predicates that tell us about divisibility. 
To see if x divides y, just form a function like this: 


aly =n ((n <y)A(M(n,x) = y)). 


3.4.4 Bounded Minimization 


If we have a predicate P(x, n1,..., 7) itis very useful to find the Jeast value of x < y 
such that P(a,n1,...n%) is true. Using the results from the previous section, that is 
not too hard to do. 


Consider 


f(y,mai,...me) = 9° (Wo((v < 2) AWP(v,m1,...,7))) - 


xr<y 


This sum will basically add 1 each time there is a value of v where the predicate is 
false for it and for all smaller values. Once the predicate is true for the first time, all the 
other terms in the sum will add zero. Thus the sum will represent the smallest value 
where the predicate is true for the first time. 


Based upon this, we can show that division is primitive recursive: 


«divy=minM(y,z+1) >a. 
z<y 


The mod function can be defined in terms of this: 


x mod y = y— «(a div y). 


Also from the fact that we can represent divisibility as a primitive recursive func- 
tion, the least common multiple (lcm(m, n)), greatest common divisior (gcd(m, n)), 
et cetera can be constructed: 


Iem(m,n) = min (m|p A n|p) 
p<mn 
gcd(m,n) = mn div (Iem(m,n)) 


It is also easy to define the prime(x) predicate, then a predicate that identifies the i*” 
prime, the number of times the i*® prime divides a given number, and so on. In fact if 
we enumerate the prime numbers as po = 2,1 = 3, p2 = 5 and so on, then given any 
nunber n, we can write primitive recursive functions that will yield ko, k,,... such that 
— »ko ki 

N= PoPy - ++ 

We can then define functions that yield the prime factorization of numbers, allowing us 
to encode multiple numbers or even strings as single numbers. See 3.5.2. 
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3.5 Functions that are not Primitive Recursive 


The examples above begin to show that the number of functions that are primitve re- 
cursive is vast—almost every function we use in day-to-day calcutions seems to fit into 
that category. But in fact, there are functions that are obviously computable that are not 
primitive recursive. In this section we will show how to construct one. 


The proof that there are effectively computable total functions that are not primitive 
recursive is based on two ideas: 


e It is possible to enumerate all of the primitive recursive functions in a logical 
way such that we can say, F; is the i*” primitve recursive function, and for every 
primitive recursive function g, there exists a / such that F;, = g. 


e Once we have enumerated all the primitve recursive functions, we use a diago- 
nalization argument to produce a function that is not in the list. Since the list 
includes all the primitive recursive functions, this new function cannot be primi- 
tive recursive. On the other hand, we can calculate the value of this new function 
for any input, and hence it is effectively computable. 


The description above glosses over some of the difficulties, and we will eventually 
make the argument completely rigorous, but first let’s see the general idea. 


Suppose that the list were not all primitive recursive functions, but rather just the prim- 
itve recursive functions of a single variable. (We will see how to produce this from the 
original list later on.) 


Thus Fo(7) is the zeroth primitive recursive function of a single variable; F\(n) is the 
first, F2(n) is the second, and so on. (We could have begun numbering the functions 
at 1, but it is slightly simpler to see what is going on if we start numbering from 0. 


In principle we can now fill in a table of all the values of all the primitive recursive 
functions that looks like this: 


[Bao] an [am [am [er 
[a0 [a Ae [a0 Per] 
[| se | er] 
a Par] a [aT er] 
[a [rar [0 [a] 


Next, we will define a new function G(n) that disagrees with the function F;(n) when 
n = i. This is easy to do: G(n) = F,(n) + 1. This G(n) disagrees with the function 
F;(n) at least at the boxed values of F; in the table above. Since G disagrees with 
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every primitve recursive function for at least one input value, G must not be in the list, 
so G must not be primitve recursive. 


On the other hand, this G which we have constructed is obviously computable. If you 
want to find the value for G(17), simply figure out what the 17‘ primitive recursive 
function is, evaluate that for the input value of 17, and add one to the result—a perfectly 
mechanical procedure. 


3.5.1 Enumerating the Primitive Recursive Functions 


Now for the more interesting part: how can the primitive recursive functions be enu- 
merated? We have to be at least a little bit careful, since if we begin with the most 
obvious approach, numbering the constant functions, we run out of natural numbers 
before we get to any other functions. 


In what follows, we will be trying to generate a “grand list” of all primitve recursive 
functions: 
Ort 14 $25.53) + 


Specifically, if we say F, is the constant zero function with one argument, F2 is the 
constant zero function with two arguments, and in general, F,, is the constant zero 
function with n arguments, then we have enumerated all the constants, but there are no 
more natural numbers to assign to other functions; they are all used up. 


And what should be done for the projections? For every 2 > 0 and j > 0, there is a 
PM, If we’re not careful, we could also use up all the natural numbers on the subset 
pe 

Here is the basic idea: the first function, Fo, will be the successor function, S(n). Next, 
we will make four lists of all the functions generated by the following four conditions, 
and will add functions to our list of all primitve recursive functions by cycling through 


the lists: first item from the first list, first item from the second, first from the third, first 
from the fourth, second from the first list, and so on. 


The list of constant functions is easy: 
Z1(n1), Zo(m1, n2), Z3(n1, n2, nz), Za(M1, M2, Nz, N4),--- 


The list of projections is a little trickier, but not difficult. We simply list all of the pu ) 
having 7 + j equal to 2, then to 3, then to 4, et cetera. Omitting the parameters, this is 


what the list of the P\ will look like: 


BPP Pe PoP (Pe Pa Py Pa Pe ite 


The list of functions made by composition is the trickiest, so we will discuss that last. 
Next, let’s look at the list of functions defined by primitive recursion. 


Any pair of primitive recursive functions f and g will define a new primitve recursive 
function h as long as g has two more parameters than f. By the time we need to add 
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the first function of this sort to our grand list, the grand list will already contain at 
least three functions: S(n), Z1(m1) and PO, Each successive time we are faced with 
adding functions generated by the third and fourth rule, there will be more functions 
on the grand list. 


If we list all pairs of functions on the grand list as we did for the projection functions 
above, then each time we need to look at a composition or recursive definition, we can 
use sets of functions previously added to the grand list. Here is the list of pairs we will 
consider in the case of functions defined by recursion: 


(Fis Fa) a)s (Prag iA Pig ayo ho) s Cae Fie FPF) ee 


For each pair, we check to see if the number of parameters of the two functions works 
out to form a valid function defined by recursion. If not, we add nothing to the grand 
list and continue in our cycle of the four lists. If we do have a valid pair, we add the 
resulting function defined by recursion to the grand list. 


Finally, the trickiest list to construct: we need to generate a linear list of all functions 
defined by substitution. We will use the same general approach that we did for the 
recursively defined functions, but this time we have to look at strings of previously- 
defined primitively recursive functions. 


This is because to make a valid substitution, we need a function f of & variables fol- 
lowed by & functions g;, 1 <i < k, each with the same number / of variables. 


What we will do is to generate all possible finite strings of function names from the 
grand list and each time we have the opportunity to add a function defined by substitu- 
tion, we will look at the next string in the set. The first function in the string will have 
some number & of variables. If the list does not contain k + 1 items, it is invalid and 
we skip it. If it does contain k + 1 items, then we examine the last k of them to see if 
each has the same number / of parameters. If that is also true, then we can generate a 
valid function for the grand list defined by substitution; if it’s invalid, we skip the list 
and continue our grand cycle of the primitive recursive function lists. 


OK, how do we make a list of all strings of functions that includes duplications and 
eventually lists all finite strings from an infinite “alphabet”? 


3.5.2 Godel Numbering 
To make the problem precise, our “alphabet” will be the list of primitive recursive 
functions on our grand list: Fo, 71, Fa,.... 
We want to output a list of all finite strings of the 7; where each string is assigned to a 
unique natural number. The list should include all of the following in some order: 

Fo, F1,F 2, F3,Fa,... 

FoF, FoF; FiFo, FiFi;FoFa; - 

FoF oF 0: FoF oF; FoF if os FoF iF; Fit oF 04. + 
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FoFoFoF0,FoFo0F0F1, FoF o0FiF0, FoF 0FiFi,-.- 


The trick we will use, called “G6édel numbering”, is based on the fact that every natural 
number has a unique prime factorization. First, list the prime numbers as follows: 
Po = 2, pi = 3, p2 = 5, p3 = 7, pa = 11, ps = 13, and so on. 


Every natural number n can be written as the following infinite product: 
Co 
ki _ ko ki nko ks pk 
a= | [pe Seer er pres 
i=0 


In every such representation, all but a finite number of the k; are equal to zero. 


An easy way to encode a string is using the exponents of the prime factors of a natural 
number. For example, suppose we wish to encode the string: 


oie ae eee T 


The following number does the trick: 


jiotl, i141, t24+1 intl 
Po! Py Py De 


We add one to each exponent, since there will be an infinte number of exponents equal 
to zero in the prime factorization of any number. 


This will assign a unique number to every string, but there will be some numbers that 
do not correspond to any string. 


Here are the first dozen valid numbers, their prime factorizations, and the correspond- 
ing strings: 


2 = pi — Fo 18 = pip) — FoF 

4 = pi—F, 24 = pip, — FoFo 

6 = pip, —> FoFo 30 = pipop3 —> FoFoFo 
8 = p>—>Fp 32 = p—Fy, 

12 = pip, — FiFo 36 = pips — FiF, 

16 = pt—>Fs 48 = pip, —> F3Fo 


There is no unique method of Gédel numbering—the method above is just an example. 
The term “Gédel numbering” just refers to the idea of encoding strings of information 
of arbitrary length using the fact that natural numbers can be factored uniquely into 
prime numbers. 


3.5.3 The Fibonacci sequence revisited 


One of the first examples of a recursive function that we presented in section 2.2.2 was 
that of the Fibonacci numbers. It seems that it should be trivial to demonstrate that this 
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sequence is primitive recursive (and it is) but it turns out to be surprisingly complicated 
to show. 


In fact, the usual way to do so uses something akin to Gédel numbering. The construc- 
tion method for recursion in defining primitive recursive functions only allows the use 
of f(m—1) in the calculation of f(n). Since the basic recursive definition of Fibonacci 
numbers is: f(n) = f(n — 1) + f(n — 2), there is no simple way to access f(n — 2) 
during the calculation of f(n). 


The easiest way to get around this problem is to define a set of helper functions that 
encodes the previous two values as exponents of primes. The number that is passed 
along looks like this: 2/("—)3/("—?)_ This can be “decoded” by primitive recursive 
functions, then the appropriate calculation is performed, and the result is re-encoded 
in the same form. The actual function that generates the numbers in the Fibonacci 
sequence executes the recursion as described above and then decodes and returns the 
exponent of 2. 


In a similar way, this method can be used to define primitive recursive functions that 
make use of any number of previous values. In fact, an arbitrary set of such values 
can be stored as the exponents of prime numbers in longer and longer Gédel numbered 
encodings of those sequences of values. 


3.6 General Recursive Functions 


In this section we will introduce one additional construction mechanism to those we 
already have for the primitve recursive functions and the resulting set of functions will 
be, in a sense, complete—we will not be able to use diagonalization arguments to 
produce addtional functions that are clearly effectively computable. 


The set of general recursive functions includes all of the primitive recursive functions, 
but provides one additional construction operation: 


6. Unbounded search function. If f(n,ni,...,%) is in the set, then so is the 
function juf(m1,...,7%) that returns the smallest n such that f(i,n1,...,nx) 
is defined fori < n and f(n,m1,...,n~) = 0. If no such n exists, then 
pop(1,..., Mx) itself is not defined. 


General recursive functions are not always total functions. For any particular function 
f, there may not be any combination of input values that cause it to evaluate to zero. 
Some general recursive functions that are not primitve recursive functions are total and 
some are not. We can speak about the set of total general recursive functions, although, 
as we shall show, it is impossible to determine in general for any specific function, 
whether it is total or not. 


There are total general recursive functions that are not primitive recursive. Perhaps the 
most well-known example is Ackermann’s function, A(z, y, z), defined as follows: 
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A(0, 0, y) y 
A(0,2+1,y) = A(0O,z,y)+1 
A(1,0,y) = 0 
A(z+2,0,y) = 
A(z+l,a+l,y) = A(z,AV+1,2,y),y) 


This amounts to: 


A(0, 2, y) 4 ur+y 

A(l,z,y) = @-y 

A(2,r,y) = 2 

A(3,z2,y) = | (y copies) 


and so on. At each successive stage the previous operation is applied y times to x. 


The standard proof that this function is not primitive recursive shows that Ackermann’s 
function increases more rapidly than any primitive recursive function can. It is also 
clear from the definiton that Ackermann’s function is total. 


We will not provide a formal proof of that here, but the basic reasoning goes as follows. 
All of the primitive recursive functions are built upon the successor function S(n). This 
is the only function that can increase an input value. 


In each round of primitive recursion, we can only take a function that has been previ- 
ously applied, and apply it repeatedly. Thus in one stage we can get to addition, then, 
in the next stage, we can get to multiplication, then to exponentiation, then to towers 
of exponents. But at any fixed stage, there is an upper limit to how fast the outputs can 
increase relative to the inputs. In Ackermann’s function, there is no limit. It is a sort of 
a diagonalization process applied to the fastest-growing primitive recursive functions 
available at each stage. 


In other words, if Ackermann’s function were primitive recursive, it would appear at 
stage n above the successor function for some n, but A(nm + 1) is much bigger than it 
could be for a function at stage n. 


It turns out that an intuitive way to look at primitive recursive and general recursive 
functions in terms of modern computer languages is that primitive recursive functions 
can all be coded up using only “for” loops; general recursive functions require “while” 
loops. The “for” loops are guaranteed to terminate (assuming that the index value is 
left unchanged inside the loop), but “while” loops are not. 
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4 Computability and General Recursive Functions 


The huge difference between primitive recursive and general recrusive functions is that 
when we begin a general recursive calculation, we do not know if it will terminate. 
Thus it is possible that for some input values to a general recursive function, the appli- 
cations of substitutions may never end. 


When the function has the form ju f(1,..., x), there may be no way to tell whether 
there are any values of n such that f(n,n1,...%) = 0. One can, of course, begin to 
plug values of n into the function to test it, but even if you’ve tested a million input 
values with no success, you still have tested zero percent of the possible inputs. And 
worse, your tests may never terminate. 


We are basically faced with the following situation: If us (n1,..., x) exists, we can 
find its value in finite time. If not, we may not even be able to prove, in any finite 
amount of time, that it does not exist. 


This may seem like a terrible situation in which to find ourselves, but it is really not as 
bad as it seems. Exactly the same situation holds when you run a computer program 
on a given input. Some programs can be proved always to halt with an output, but for 
a general program, it is impossible to know. Just because there are some bad programs 
does not mean that we avoid them altogether, and just because there are “bad” general 
recursive functions does not mean that general recursive functions should be avoided 
altogether. 


5 Effective Computations 


Perhaps the easiest way to indicate what is meant by an effective computation is to 
illustrate a function for which no effective computation is known. 


Every natural number larger than 1 can be written as the sum of prime numbers, often 
in many different ways. For example: 2 = 2,3 = 3,4=24+2,5=2+3,6=3+3= 
24+242,7=7=2+2-+3, etcetera. Let f(n) be the smallest natural number that 
requires at least n + 1 primes in such a summation. If every number can be expressed 
as a sum of fewer than n + 1 primes, then f(n) = 0. 


Thus f(0) = 2 since 2 = 2 requires a single prime. We have f(1) = 4, since 4 = 242 
and 4 is not prime, so at least two primes must add to give 4. Similarly, f(2) = 27. 
What is f(3)? Nobody knows (at least at the time this was written). If the Goldbach 
conjecture is true, then f(3) = f(4) = --- = 0. The Goldbach conjecture states that 
every integer greater than | can be expressed as the sum of three or fewer primes. The 
Goldbach conjecture has been tested for all integers smaller than 6 x 101° at the time 
of this writing. 


It is easy to imagine writing a program that attempts to calculate f(n) as follows: 


For each m, look at all possible sums of sets of n or fewer prime numbers less than m 
and see if they sum to m. If not, return m; otherwise repeat this operation with the next 
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larger value of m. 


The problem is that if Goldbach’s conjecture is true, the program will never terminate 
for n > 2. This is hardly an effective computation method, since although you may 
have waited a million years for the program to terminate and it is still running, that 
does not mean that it might not return with the answer in the next second. 


6 Most Functions Are Not Effectively Computable 


It may seem surprising at first, but almost all functions that map N — N are not 
effectively computable. This is because there are only a countable number of computer 
programs of finite length and there are an uncountable number of functions mapping 
NN. 


One way to see that is that every computer program can be written as a finite sequence 
of characters. If we assume, say, that there are 100 valid characters that can be used 
in any program, then there are at most 100” sequences of characters of length n, and 
only a tiny number of those sequences will be valid computer programs. Thus the total 
number of valid programs of length n characters or less is smaller than: 


100' + 100? + 1007 + --- + 100", 
which is just a (rather large but finite) natural number. 


If we let S,, be the set of all valid programs of length n, then the set S' of valid programs 


is just 
Co 
ee ace 
n=1 
Since S'is a countable union of countable sets, it is clearly countable. 


The number of functions mapping N to itself is, however, uncountable. This can easily 
be shown with a variant of Cantor’s diagonalization argument. Suppose that there were 
only a countable number of such functions. Then we could enumerate them as fo(n), 
fi(n), fo(n), et cetera. Now define a new function g(n) as follows: 


g(n) = fr(r) +1. 


We know that for every 7, g cannot be equal to f;, since they differ when evaluated at 
i: g(t) = fi(t) +1 4 fi(i). Thus the set of functions cannot be enumerated with the 
natural numbers, so it must be uncountable. 


Thus, almost every function f mapping N to N is not effectively computable. 


7 Interesting Functions 


fia) = 1: ifarunof exactly x 5’s occurs in the decimal expansion of 7 
. 0 : otherwise 
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if a run of at least x 5’s occurs in the decimal expansion of 7 
otherwise 


fate) = { 

fey = if the number x occurs in the decimal expansion of 7 
? = otherwise 

if Goldbach’s conjecture is true 

otherwise 


or OF OF 


fale) = { 


Since 7 = 3.1415926535897 ..., we know that f3(1) = f3(141) = f3(159265) = 1. 
It is unknown whether there exists an x such that f3(x) = 0. 
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